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Preface 


This  report  studies  the  use  of  a fuel  conservation 
near-optimal  control  law  by  an  evading  spacecraft.  A form 
of  differential  dynamic  programming  is  used  to  solve  the 
optimal  control  problem.  The  object  of  this  study  Is  to 
test  the  control  against  different  pursuers  to  determine 
if  such  a scheme  is  advantageous. 

I wish  to  express  my  appreciation  to  Prof.  Gerald 
Anderson  of  the  Air  Force  Institute  of  Technology  for  his 
assistance  and  advice.  I wish  to  thank  my  family  for 
their  consideration  and  cooperation  during  this  study. 


William  V.  Green 
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GA/MC/76D-8 


Abstract 


A fuel  conservation  control  law  for  an  evading  space- 
craft is  tested  in  a free  final  time,  pursuit-evasion 
differential  game. 

A form  of  differential  dynamic  programming  with 
periodic  updating  is  used  to  solve  the  optimal  control 
problem.  The  control  law  is  tested  against  two  different 
kinds  of  pursuers.  One  of  the  pursuers  is  using  the  same 
updating  of  the  optimal  control  scheme  and  the  other 
pursuer  is  using  a non-optimal  control  law.  The  non- 
optimal  control  law  produces  a collision  course  between 
the  two  craft. 

The  evader  is  able  to  take  advantage  of  any  non- 
optimal  play  by  the  pursuer.  The  evader  is  able  to  opti- 
mize the  combination  of  final  range  and  final  mass, 
depending  on  the  mission. 

Plots  comparing  the  flight  path  of  the  evader  and 
several  different  pursuers  are  included. 


A FUEL  CONSERVATION  NEAR  OPTIMAL 
f CONTROL  LAW  FOR  AN  EVADING  SPACECRAFT 


I.  Introduction 


** 
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Background 

In  1954,  Rufus  Isaacs  introduced  the  theory  of  dif- 
ferential games.  Since  that  time,  differential  games 
have  been  applied  to  a diverse  number  of  problem  areas. 

In  his  book,  Isaacs  develops  the  theory  of  differential 
games  (Ref  1).  He  examines  some  pursuit-evasion  games 
using  his  theory  to  provide  minimax  solutions  to  the 
games.  However,  the  pursuit-evasion  examples  are  developed 
using  simple  models. 

Anderson  developed  near-optimal  solutions  to  non-linear., 
zero-sum  differential  games  using  a transition  matrix  method 
and  a matrix  Racatti  backsweep  method  (Refs  5 and  6). 

Anderson  and  Bohn  applied  both  of  these  methods  to  a pursuit- 
evasion  game  between  two  spacecraft  (Ref  3).  This  control 
law  was  developed  for  the  pursuer  to  take  advantage  of  the 
non-optimal  play  of  the  evader.  Anderson  and  .Bohn  applied 
the  closed-loop  control  law  to  a realistic  problem  with 
a large  state  vector.  There  were  some  problems  in  the 
methods  with  instability  of  the  matrix  Racatti  backward 
Integration.  A solution  to  the  initial  two-point  boundary 
value  problem  (TPBVP)  is  also  required  to  start  the  methods. 
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Jacobson  and  Mayne  developed  the  method  of  Differen- 
tial Dynamic  Programming  (DDP)  to  provide  a way  to  solve 
the  optimal  control  problem  (Ref  2).  Jarmark  suggest 
a method  of  applying  DDP  to  differential  games  (Ref  7). 

Statement  of  the  Problem 

This  study  applies  a near-optimal  control  for  an 
evading  spacecraft  which  is  attempting  to  maximize  the 
final  distance  between  the  pursuer  and  himself  and  also 
to  minimize  the  fuel  required  by  the  evader.  A form  of 
DDP  is  used  to  solve  the  optimal  control  problem. 

This  study  assumes  two-body  dynamics  in  a Newtonian, 
inverse  square  gravitational  field.  The  only  forces 
acting  on  the  bodies  are  gravity  and  thrust.  All  other 
perturbative  forces  are  assumed  insignificant  in  magni- 
tude compared  to  thrust  and  gravity. 

The  payoff  is  the  final  range  and  the  evader's  final 
mass.  The  pursuer  is  trying  to  minimize  the  payoff  and 
the  evader  is  trying  to  maximize  the  payoff. 

The  control  law  is  tested  against  a pursuer  using 
the  same  near-optimal  control  and  one  using  a non-optimal 
collision  course  guidance.  The  assumption  of  perfect 
information  is  made  for  both  pursuers. 

Approach 

Chpater  II  is  a description  of  a differential  game. 
This  is  only  a general  description  and  is  not  meant  as 
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II.  Differential  Game 


General  Development 

The  differential  game  is  the  result  of  an  optimal 
control  problem  with  two  players.  The  players  are 
attempting  to  minimize  or  maximize  a cost  functional 


- p i TtC-j-J , 'ifj  J" L ( "V  <4  f ^ ~i)  O t 


Subject  to  the  terminal  constraints 


V (vUc  , sr  J ■'  o 


and  the  dynamic  equations  of  motion 


where  u is  the  minimizer's  control  and  v is  the  maxi- 
mizer's control.  The  controls  that  result  in  the  minimax 
solution  are  u^,  v°  such  that 


J (t f*v)  - - J(*  v) 


The  solution  to  this  problem  is  found  by  adjoining  the 
state  equations  to  the  cost  functional  using  time  varying 


Lagrange  multipliers.  This  results  in  an  augmented  cost 
functional  J 


r - 


The  Hamiltonian  is  defined  as 


H ■ L+)f 


thus 


<4 


(5) 


(6) 


J'  - T*]<*  (7) 


Taking  a variation  and  expanding  results  in  the  following 
conditions 


r-  -h* 

^ (tf)  (&K  ~f^r 

and  the  optimality  conditions  are 


(8) 

(9) 


Differential  Dynamic  Programming 

The  method  used  to  solve  this  optimal  control  problem 
is  a form  of  differential  dynamic  programming  (DDP)  as 
suggested  by  Jarmark  (Ref  7).  The  procedure  involves 
integrating  the  state  equations  forward  .with  a guessed 
control.  At  the  final  time  the  transversal i ty  conditions, 
Eq.  (10),  are  enforced  to  provide  boundary  conditions  for 
Eq.  (9).  As  shown  in  Ref.  8,  these  equations  and  the  state 
equations  are  then  integrated  backward  from  t^  to  tg. 

At  each  integration  step  the  optimality  conditions,  Eqs. 
(10)  and  (11),  are  enforced.  To  predict  the  cost  change 
caused  by  usi ng  the  new  control,  a predicted  cost  change 


equation  is  integrated  along  the  backward  trajectory. 
The  predicted  cost  change  is 


a(i)*  H (t  '+X'O  " \i) 

where  u"  is  the  new  control  found  during  the  backward  inte- 
gration. This  equations  is  initialized  at  t^  using 


(13) 


The  state  equations  are  then  integrated  forward  again, 
using  the  new  control.  At  the  final  time  the  actual  cost 
change  resulting  from  the  new  control  is  computed.  A 
comparison  is  then  made  of  the  actual  cost  change  and  the 


<'  \ x l *3  * £’  *fW'  * 


predicted  cost  change  to  determine  If  the  new  control  Is 


closer  to  the  optimal  control.  If  the  actual  cost  change 
and  the  predicted  cost  change  differ  too  much  then  an 
adjustment  Is  made  In  the  Integration  step  size.  This 
procedure  Is  continued  until  the  control  converges  to 
the  optimal  and  the  cost  change  becomes  negligible. 
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III.  Specific  Game 


State  Equations 

The  equations  of  motion  are  derived  using  spherical 
coordinates  and  a Newtonian,  inverse  square  gravitational 
field.  Fig.  1 shows  the  coordinate  frame  used  where  R.  is 
the  position  vector.  The  thrust  is  defined  in  the  body 
fixed  reference  frame  shown  in  Fig.  2.  The  relationship 
of  the  body  fixed  frame  and  the  inertial  frame  can  be 
seen  in  Fig.  1. 


Fig.  1 Inertial  Coordinate  Frame 
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Fig. 

2 Body  Fixed  Reference  Frame 

The 

resulting  equations  of 

motion  are 

r 

■ v. 

(14) 
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To  normalize  the  equations 

of  motion. 

define  the 

state 

varl 

ables 
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* s*m 
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X,  = r/t 

/?  “ d 


V,  - Q 


(20) 


(21) 


(22) 


*r/V, 

~ V^/y'a 

y<*  ■ 

y7  = rv\/rr\. 


(23) 


(24) 


(25) 


(26) 


where  rQ  Is  the  radius  of  a circular  orbit  at  the  surface 
of  the  earth,  VQ  is  the  transverse  velocity  of  that  cir- 
cular orbit  and  MQ  Is  the  initial  mass  of  the  spacecraft. 
Next  we  can  non-dimensional Ize  the  time  units  by  Introduc- 
ing the  non-dimensional  unit 


The  time  derivatives  then  become 


d o * di  = io.dn 

dt  d v0  dr 


(28) 


The  non-dimensionalizeti  state  equations  are  then 


/x, 


(29) 
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(30) 


~ ys /{X  '■'di  /\) 

V *<./*,  (31) 

*«  r +K}/*,  ~ i A1  ■*  (j/Xy)  Cos  «>  ~°<>  (32> 

XV-  “ (&  * x<  ^dir  y>  )/k  •>  r \ /\-=x,  (33) 

Yt  r ' CV1  ^ *s*  4a r /.»)/'<,  -<■  (t/x,)  (34) 

y, r -r/c  (35) 


Cost  Function 

The  cost  function  contains  a range  term  and  a mass 
term.  There  Is  a weighting  coefficient  on  the  mass  term 
to  allow  a variation  in  the  relative  magnitude  of  the  two 
terms.  The  cost  function  is 


a> 


j - i r + r. 


rviO.  ^ 


rr\, 


Y^eo) 


(36) 


where 


R 


Fmc 

m 


Is  the  range 

Is  the  final  mass  weighting  coefficient 

Is  the  evader's  mass 

Is  the  evader's  Initial  mass 


The  range  Is  found  using  spherical  trigonometry  as 


r e * fp  - 3 r*p  LCoS  &e  CoS&p  Cd*  " ^,0 
■+■  5 i»n  &&  "5\a  &p~J  (37) 
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where  rg  and  rp  are  the  magnitude  of  the  evader's  and 
pursuer's  ranges  respectively.  The  subscript  e denotes 
the  evader  and  the  subscript  p denotes  the  pursuer.  The 
mass  term  contains  only  the  evader's  mass  and  this  term 
Is  normalized  by  dividing  by  the  evader's  Initial  mass. 

Adjoint  Equations 

The  Hamiltonian  is  formed  from  Eq.  (7) 


(38) 


Applying  Eq . ( 9 ) results  In  the  following  adjoint  equations 


)*r  - ^ % 
r r 


4 0 - (^r^o  + V/  $ ) 

r 


(39) 


V = 


(40) 


_ - ^ ^ & ~ ~\vp  V/  Vg,  5s  t*  S + 5e c*  O 


(41) 


(42) 
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~ ' ^ /cot.  9 - /<£  Ve-lj„9  Vy J' 


yve^^  % V ^ w (43) 


^ " - \ -j\  Vo  * ’/„  -hr  9 -/  X,  Vr 


(44) 


X»  ~ 'ri ( Cc>z  <*,  -*•  Xyt  r>oofj  Cgs^  4 J^SlAofj] 


The  boundary  conditions  for  the  adjoint  equations  are 
found  using  eq.  (9)  where 


$ “ J [ re  *■  -Jrtrp^ns  t?e  <*0  5 6>p  <?o  5 (<rfe  - </p) 
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(46) 


thus 
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(51) 
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(52) 
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I r 
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) ~ ~*€rp  cos  Op  4in  foe'  4p)  (53) 
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*o  (55) 

The  transversal ity  conditions  are  the  same  for  both 
players  except  for  W“  5-  ' 

Optimality  Conditions 

The  optimality  conditions  are  derived  In  Appendix  A. 
They  result  when  the  inequality  condition  is  enforced  in 
Eqs. (10)  and  (11).  The  resulting  optimal  controls  are 


SlA  <*,  * 4 3vj j«)^ 

CaS*\  " / ft*  +* 

S\n  f 

for  the  evader  and  for  the  pursuer 

*1**,  * ^p/  Qs(f  + 

Co^oc* 

*****  * m\mf/$Vrp  4 4 X0pj^ 


(56) 


(57) 


(58) 


(59) 


(60) 
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II.  The  method  used  in  this  study  does  not  compare  the 
predicted  and  actual  cost  change  in  order  to  adjust  or 
modify  the  convergence  of  the  integration.  The  control 
change  is  constrained  to  prevent  large  variations.  This 
restricts  the  state  trajectory  to  a weak  variation  from 
the  nominal.  The  predicted  and  actual  cost  changes  are 
used  to  determine  if  the  method  should  be  converging  or 
If  the  new  control  is  closer  to  the  optimal  control.  The 
DDP  method  is  used  for  five  iterations  at  each  update. 

The  control  is  updated  at  specified  time  intervals 
along  the  flight  trajectory.  The  new  or  updated  control 
should  allow  the  evader  to  take  advantage  of  any  non- 
optimal  control  used  by  the  pursuer.  By  using  the  DDP 
method  many  times  during  the  game,  the  control  converges 
slowly  to  the  optimal  control.  Thus,  the  control  may 
not  be  optimal  at  the  beginning  of  the  game,  but  approaches 
the  optimal  with  time. 

Pursuer 

The  evader's  near-optimal  control  scheme  is  used 
against  two  types  of  pursuers.  The  first  type  uses  the 
same  near-optimal  scheme  outlined  above. 

The  non-optimal  pursuer  uses  collision  course  guid- 
ance. This  is  implemented  by  resolving  the  Inertial 
velocity  difference  between  the  two  spacecraft  into  two 
components.  One  component  is  along  the  line  of  sight  (LOS) 
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between  the  two  spacecraft  and  the  other  component  is 
perpendicular  to  the  LOS  in  the  plane  formed  by  the  LOS 
and  the  velocity  difference  vector.  The  pursuer's  thrust 
Is  then  directed  so  as  to  null  the  velocity  in  the  per- 
pendicular direction  with  any  remaining  thrust  In  the  LOS 
direction.  These  two  components  define  the  thrust  vector. 

Final  Time 

The  final  time  Is  free  In  this  study  and  a stopping 
condition  Is  used  to  stop  the  forward  integration.  The 
theoretical  condition  of  J = 0 was  initially  used.  This 
condition  was  solved  analytically  and  involved  the  mass 
terms.  The  relative  magnitude  of  the  range  term  and  the 
mass  term  are  rather  Important.  If  the  final  mass  coef- 
ficient (Fmc)  Is  not  judiciously  choosen,  the  mass  term 
dominates  the  J equation.  This  could  force  the  game  to 
continue  past  the  time  of  closest  approach.  For  this 
reason*  the  stopping  condition  was  changed  to  the  range 
rate,  or  R.  This  means  that  as  long  as  the  two  craft  are 
closing,  the  game  will  continue,  but  as  soon  as  the  range 
begins  to  Increase  the  game  stops.  Any  strategies  which 
require  the  pursuer  to  Increase  the  range  to  gain  an 
advantage  are  precluded  from  this  study.  Due  to  the 
distances  and  times  involved  In  this  study,  this  strategy 
Is  not  considered  as  a significant  strategy.  The  stopping 
condition  of  R * 0 Is  solved  analytically  and  checked 


after  each  integration  step.  By  using  the  R condition, 
the  Fmc  can  be  adjusted  to  meet  the  requirements  of  the 
evader's  mission  and  not  the  game  stopping  condition. 

If  the  evader  were  critically  short  on  fuel,  then  he  could 
increase  the  Fmc  to  gain  a fuel  savings  and  still  main- 
tain an  acceptable  miss  distance. 
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The  control  law  algorithm  was  simulated  on  a CDC  6600 
computer  using  a fourth  order  predictor-corrector  Integra- 
tion routine.  The  integration  step  size  was  0.005  TU, 
or  4.034  seconds.  The  control  law  was  updated  every  six 
integration  steps,  which  is  24.2  seconds.  The  method 
was  started  with  a Runga-Kutta  integration  routine. 


The  state  equations  are  integrated  forward  using  a 
quessed  control  for  the  first  update.  On  successive 
updates,  the  previous  control  is  used  for  the  first 
integration.  The  initial  update  uses  the  velocity  vector 
as  the  direction  for  the  guessed  control. 

Initial  Condi ti ons 

The  control  algorithm  is  tested  against  five  different 
cases.  The  initial  conditions  are  shown  in  Table  I.  The 
evader  begins  from  the  same  initial  conditions  in  each 
case.  The  first  four  test  cases  were  choosen  arbitrarily 
by  taking  the  equations  of  motion  and  integrating  backward 
from  a collocated  point  with  no  thrust.  The  assumption 
was  made  that  an  intercepting  spacecraft  would  not  have 
to  thrust  excessively  to  Intercept  an  orbiting  space- 
craft with  no  thrust.  The  evader  is  assumed  to  be  Initially 
In  a stabilized  orbit.  The  Initial  conditions  for  case  V 
are  the  same  as  those  of  the  last  case  in  Reference  3. 

Cases  II,  III,  and  IV  are  coplanar  in  the  initial  conditions. 
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while  cases  I and  V are  non-copl anar.  The  same  equations 
of  motion  are  used  in  all  cases  and  the  control  is  not 
restricted  to  planar  changes,  thus  cases  II,  III,  and  IV 
may  involve  an  intercept  that  is  out  of  the  initial  orbit 
plane. 

Results 

The  results  are  shown  in  Tables  II  through  XI. 

Tables  II,  IV,  VI,  VIII,  and  X are  the  results  for  the 
case  of  a near-optimal  pursuer  and  a near-optimal  evader. 
Tables  III,  V,  VII,  IX,  XI  are  the  results  for  the  non- 
optimal  pursuer  and  a near-optimal  evader. 

There  are  two  parameters  which  are  varied  in  the 
study.  The  Fmc  is  used  to  determine  the  relative  magnitude 
of  the  range  and  mass  terms  in  the  cost  function.  If  the 
mass  Is  given  more  relative  weight,  then  the  final  range 
is  decreased.  Decreasing  the  Fmc  produces  an  increase  in 
the  final  range.  The  ratio  of  the  final  mass  to  initial 
mass  is  between  0.7  and  1.0.  The  Fmc  is  varied  between 

_3 

0.0  and  4 X 10  . Control  changes  are  constrained  by 

preselected  constants.  The  angle  change  is  arbitrarily 
restricted  to  10°  and  the  thrust  restriction  is  varied. 

The  unconstrained  thrust  change  Is  either  no  change  or 
a bang-bang  change  from  maximum  thrust  to  no  thrust. 

This  is  due  to  the  Hamiltonian  being  linear  In  the  thrust 
terms.  If  the  coefficients  of  thrust  are  combined  they 
can  be  termed  the  switching  function  for  thrust.  The 
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Case 

R 

0 

(No.) 

(KM) 

(DEG.) 

1 

6524.9 

70.473 

2 

6505.7 

70.531 

3 

6467.5 

70.302 

4 

6467.5 

63.541 

5 

6505.7 

70.474 

Evader 

7016.0 

57.296 

Vr 

(KM/SEC) 

Vd 

(DEG/SEC) 

Ve 

(DEG/SEC) 

3.953 

0.545 

-0.025 

-0.027 

0.000 

0.478 

-0.025 

0.000 

0.000 

0.510 

-0.023 

0.000 

0.000 

0.510 

0.023 

0.000 

4.057 

0.560 

-0.025 

-0.027 

0.000 

0.000 

0.068 

0.000 

I 


i 


% 


thrust  can  only  go  from  zero  to  the  maximum  value.  For 
the  mlnimizer,  the  thrust  will  be  maximum  when  the  switch- 
ing function  is  negative  and  thrust  will  be  zero  when  the 
switching  function  is  positive.  The  thrust  for  the  maxi- 
mizer is  determined  in  the  same  manner  except  the  positive 
switching  function  produces  maximum  thrust  and  a negative 
switching  function  produces  zero  thrust.  To  avoid  this 
bang-bang  control,  a thrust  change  constraint  (AK)  was 
used.  The  thrust  change  was  the  result  of  the  switching 
function  divided  by  AK.  The  value  of  10-1^  for  AK  was 
found  to  provide  the  best  results.  The  smaller  AK  was, 
the  larger  was  the  thrust  change,  however.  If  the  thrust 
change  is  too  small,  the  thrust  may  never  make  any  signi- 
ficant change.  Values  of  10~10  to  10~12  were  used  to  .‘-I 

produce  the  results  shown  in  the  following  tables. 

Discussion 

The  results  shown  in  Tables  II  - XI  are  as  anticipated, 
when  the  mass  term  is  weighted  more,  the  range  decreases 
and  the  final  mass  Increases.  There  are  some  cases,  however, 
where  the  trend  takes  a sudden  dip  that  is  considerably 
greater  then  expected.  This  could  be  the  result  of  many 
variables,  but  the  primary  one  that  the  convergence 
for  that  case  was  poor.  Another  possibility  is  that  the 
thrust  was  not  able  to  change  fast  enough.  The  average 
value  of  the  switching  function  is  around  10"^,  although 
in  some  cases  this  value  may  vary  considerably.  If  the 
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thrust  can  only  go  from  zero  to  the  maximum  value.  For 
the  mlnlmlzer,  the  thrust  will  be  maximum  when  the  switch- 
ing function  Is  negative  and  thrust  will  be  zero  when  the 
switching  function  is  positive.  The  thrust  for  the  maxi- 
mizer Is  determined  In  the  same  manner  except  the  positive 
switching  function  produces  maximum  thrust  and  a negative 
switching  function  produces  zero  thrust.  To  avoid  this 
bang-bang  control,  a thrust  change  constraint  (AK)  was 
used.  The  thrust  change  was  the  result  of  the  switching 
function  divided  by  AK.  The  value  of  10“^  for  AK  was 
found  to  provide  the  best  results.  The  smaller  AK  was, 
the  larger  was  the  thrust  change,  however.  If  the  thrust 
change  Is  too  small,  the  thrust  may  never  make  any  signi- 
ficant change.  Values  of  10”^°  to  10“12  were  used  to 
produce  the  results  shown  In  the  following  tables. 

Discussion 

The  results  shown  In  Tables  II  - XI  are  as  anticipated, 
when  the  mass  term  Is  weighted  more,  the  range  decreases 
and  the  final  mass  Increases.  There  are  some  cases,  however, 
where  the  trend  takes  a sudden  dip  that  Is  considerably 
greater  then  expected.  This  could  be  the  result  of  many 
variables,  but  one  possibility  Is  that  the  convergence 
for  that  case  was  poor.  Another  possibility  Is  that  the 
thrust  was  not  able  to  change  fast  enough.  The  average 
value  of  the  switching  function  Is  around  10"^  , although 
In  some  cases  this  value  may  vary  considerably.  If  the 
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switching  function  changes  considerably,  then  the  thrust 
change  will  be  too  great  or  too  small.  The  use  of  the  AK 
parameter  was  designed  to  smooth  out  the  rapid  switching 
caused  by  a switching  function  of  very  small  magnitude 
which  could  vary  from  positive  to  negative  values  due  to 
errors  In  computing  the  components.  If  the  switching 
function  Is  extremely  small,  some  of  its  components  are 
even  smaller  and  the  chance  of  a sign  error  as  a result 
of  additive  errors  exists.  The  use  of  the  AK  parameter 
was  designed  to  reduce  the  effect  of  this  error,  yet  it 
may  also  reduce  the  optimality  of  the  thrust  change. 
Another  possible  method  Is  to  allow  the  thrust  to  switch 
rapidly  or  by  some  preselected  amount  per  Iteration 
unless  the  magnitude  of  the  switching  function  Is  less 
then  some  very  small  value.  When  the  small  magnitude 
check  is  satisfied,  the  use  of  an  AK  type  of  parameter 
may  be  useful. 
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AK 

( x 1 0” 1 1 ) 


0.1 


0.1 


1.0 


1.0 


1.0 


1.0 


10.0 


Fmc 

(xl 0”3 ) 


ange 

(NM) 


ss 

ugs) 


6.314 

1035.0887 

0.217 

949.3241 

5.618 

1068.9366 

3.199 

1097.3665 

0.484 

1101.2084 

6.325 

1192.1009 

2.251 

1045.7356 

Table  II.  Case  1 and  Near  Optimal  Pursuer 


(xl  0" 


0.1 


0.1 


1.0 
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1.0 


1. 


10.0 


-11) 


(Xl 0”3 ) 


■ 


ange 

(NM) 


45.231 

1080.0531 

34.577 

1199.8874 

55.383 

1008.3273 

48.478 

1063.1035 

45.831 

1096.6912 

39.540 

1149.7747 

57.237 

1079.0888 

Table  III.  Case  1 and  Non-Optlmal  Pursuer 


(xlO"11) 


0.1 
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1.0 


1.0 


1.0 


1.0 


10.0 


(xlO"J) 


■ 


ange 

(NM) 


5.168 


1.919 


2.90 


0.636 


2.113 


2.162 


1.808 


Mass 
(SI ugs ) 


1077.9560 


1234.9775 


1083.7555 


1036.3445 


994.8289 


1250.0000 


1130.7665 


Table  IV.  Case  2 and  Near  Optimal  Pursuer 


(xlO-1 1 ) 


(xl 0~3 ) 


Range 

(NM) 


55.272 

1082.7480 

39.517 

1250.0000 

55.189 

1085.3884 

52.378 

1114.7330 

45.937 

1181.1390 

39.517 

1250.0000 

49.715 


1129.5821 


Table  V.  Case  2 and  Non-Optimal  Pursuer 


AK 

(xlO”11) 


0.1 


0.1 


1.0 


1.0 


1.0 


1.0 


10.0 


(xl 0”3 ) 


6.627 

0.768 

3.712 

0.549 

1.303 

0.557 

2.576 


Mass 

(Slugs) 

1077.7022 

1239.9775 

1083.9067 

1098.7667 

993.9869 

1244.9887 

1130.9590 


Table  VI.  Case  3 and  Near  Optimal  Pursuer 


AK 
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0.1 


1.0 


1.0 


1.0 


1.0 


10.0 


(xl 0~3 ) 


ange 


Mass 


55.870 

1082.6532 

40.091 

1250.0000 

55.786 

1085.4122 

53.029 

1114.2273 

46.572 

1181.4098 

40.091 

1250.0000 

50.294 

1129.9751 

Table  VII.  Case  3 and  Non-Optimal  Pursuer 


AK 

(xl O”1 1 ) 

Fmc 

( x 1 0”3 ) 

wm 

0.0 

0.0 

13.238 

1078.1804 

0.1 

2.0 

0.305 

1250.00 

1.0 

0.0 

8.146 

1092.9568 

1.0 

0.8 

2.291 

1135.758- 

1.0 

2.0 

4.092 

1035.4466 

1.0 

4.0 

2.275 

1250.00 

10.0 

2.0 

5.879 

1111.9201 

Table  VIII.  Case  4 and  Near  Optimal  Pursuer 


AK 

(xlO"11) 

Fmc 

( x 1 0~  3 ) 

Range 

(NM) 

Mass 
(SI ugs ) 

0.1 

0.0 

53.233 

1088.8661 

0.1 

2.0 

38.374 

1250.00 

1.0 

0.0 

49.234 

1149.4164 

1.0 

0.8 

51.850 

1129.7944 

1.0 

2.0  ' 

46.772 

1167.8777 

1.0 

4.0 

38.374 

1250.00 

10.0 

o 

• 

CVJ 

51.500 

1118.0301 

Table  IX.  Case  4 and  Non-Optlmal  Pursuer 
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(xl0~3) 
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21.159 

922.6761 

20.967 

944.3129 

21.168 

922.6502 

21.168 

932. 9685 

21.161 

925.7350 

20.948 

945.7547 

17.396 

922.8219 

Table  X.  Case  5 and  Near  Optimal  Pursuer 
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10.0 


(xl 0“ J ) 
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(NM) 


31.916 

1038.2526 

22.848 

1149.7747 

37.452 

990.1154 

34.698 

1026.0931 

30.030 

1086.2113 

25.099 

1146.7747 

37.619 

1002.7996 

Case  5 and  Non-Optimal  Pursuer 


V.  Cone! usions 


The  data  indicate  a small  fuel  savings  when  using  a 
Fmc  other  than  o.o.  There  is  also  the  anticipated  reduc- 
tion in  the  final  range.  The  usefulness  of  this  method 
is  therefore  dependent  on  the  mission. 

A mission  requiring  fuel  only  for  evasive  maneuvering 
would  probably  not  use  this  near  optimal  control  scheme. 

A mission  that  requires  fuel  for  orbital  maneuvering, 
station  keeping,  or  long  duration  multiple  evasions  could 
gain  some  fuel  savings  with  this  near  optimal  scheme. 

Further  study  could  make  the  program  more  efficient. 

The  scheme  could  also  be  tested  against  a variety  of  pur- 
suers. Optimization  of  the  various  parameters  in  the  scheme 
could  then  be  attempted.  This  study  has  shown  that  a near 
optimal  control  scheme  for  an  evading  spacecraft  can  be 


used  to  produce  a minimum  fuel  savinos. 
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The  optimality  conditions  are  found  by  taking  the 
partial  derivative  of  the  Hamiltonian  with  respect  to 
the  controls.  Solving  for  the  controls  results  in  a choice 
of  positive  or  negative  values.  The  decision  of  which 
value  to  use  is  based  on  the  second  partial  derivative  of 
the  Hamiltonian  with  respect  to  the  controls.  This  is 
based  on  the  assumption  that  the  Hamiltonian  is  separable 
which  it  is  in  this  case  if 


( 


= s' (}p  >/>) 

Solving  Eq.  (A-3) 


* o 


( A— 6 ) 


[0/re  -*  .3  (*«,)<•£?;(**  ^ ^ Jr/1«v4  ~ /c*]/*'  & (A~7) 

T/kv,  [Ce»5°<«  (~  ~}^r e Sira'S  ■*■  = c>  (A-8) 

C^J^,  Sl^'X,)  + }Vs>c  =0  (A-9) 


Since  ^ o the  bracket  term  must  be  equal  to  zero. 
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/vt»g- 
^ v^t 


Sin  ^ , 

c’cso'i 


( A— 1 0 ) 


or 


Sm«,  = ± / pVrt  + 


C0S«,  * - ^vre/ (^/r«  •+  "X/A  )/L 


( A— 1 1 ) 
(A-12) 


To  decide  which  sign  to  use  solve  Eq  ( A- 5 ) 
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then  substituting  Eqs.  (A-ll ) and  (A-12)  into  (A-74) 


lhL°  ( A - 1 6 ) 


By  choosing  the  positive  sign  in  Eqs.  (A-ll)  and  (A-12) 
we  insure  that  Eq.  ( A- 1 6 ) is  satisfied.  Substituting 
into  Eq.  ( A - 9 ) and  solving  for  ^ 


COZ 


° (A-17) 


or 


- Xf/[(x,r*  -XsVq:.  - xf  )hJ  <a-i8> 

510^=  - Xf:  /(Xf  - K^)A  (A_,9) 

<**-.  ••  f-A;  < X, )/(&  ^ ' Xtf  <A-2°) 


Substituting  into  Eq.  ( A- 1 5 ) 


(A— 21 ) 


By  choosing  the  positive  sign  in  Eqs.  ( A- 1 9 ) and  (A-20) 
we  insure  that  Eq.  ( A - 2 1 ) is  satisfied.  For  the  optimality 
conditions  on  the  pursuer  the  same  equations  are  used 


except  that  Eqs . ( A — 1 5 ) and  ( A — 1 6 ) result  in  a requirement 
for  greater  than  or  equal  to  zero  instead  of  the  less  than 
or  equal  to  requirement  for  the  evader.  This  changes  the 
signs  on  the  cosine  and  sine  functions  so  that 
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Fig.  B-7  Case  1 


PURSUIT— EVASION 

NON-OPT  PURSUER. OPT  EVADER 


_0L  X 


PURSUIT-EmSION 


PURSUIT— EmSION 

OPT  PURSUER, OPT  EVADER 


PURSUIT-EmSION 

OPT  PURSUER, OPT  EVADER 


Fig. B-ll  Case 
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PURSUIT— STON 

NON-OPT  PURSUER. OPT  EVADER 


Fig.  B-34  Case  5 AK  = 10.0  X 10 
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ABSTRACT  (Continue  on  nnrra  old#  If  neceeeery  and  identity  by  Mock  number) 

A fuel  conservation  control  law  for  an  evading  spacecraft  is  tested  in  a free 
final  time, pursuit-evasion  differential  game. 

A form  of  differential  dynamic  programming  with  periodic  updating  is  used  to 
solve  the  optimal  control  problem.  The  control  law  is  tested  against  two 
different  kinds  of  pursuers.  One  of  the  pursuers  is  using  the  same  updating 
of  the  optimal  control  scheme  and  the  other  pursuer  is  using  a non-optimal 
control  law.  The  non-optimal  control  law  produces  a collision  course  between 
the  two  craft.  „ ^ 
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20.  The  evader  is  able  to  take  advantage  of  any  non-optimal  play  by  the 
pursuer.  The  evader  is  able  to  optimize  the  combination  of  fimal  range 
and  final  mass,  depending  on  the  mission. 

Plots  comparing  the  flight  path  of  the  evader  and  several  different 
pursuers  are  included. 


